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(54) Vascular imaging with adaptive averaging 

(57) A reference image R is selected and a region 
of interest (ROI) is interactively selected (1,13) encom- 
passing a desired structure from a sequence of images 
(11) of a moving structure. This ROI is cross-correlated 
with other real-time images by multiplication in the Fou- 
rier frequency domain, to determine if the desired struc- 
ture is present in the image. If the structure is present, 
this image may be averaged with other images in which 



the structure is present to produce higher resolution 
adaptively averaged images. This invention is particu- 
larly useful in imaging coronary vessels. In an alterna- 
tive embodiment, the offset of the desired structure may 
be calculated in a series of images. The images may 
then be sorted by this offset, and played back in that 
order to provide a "movie-like" display of the desired 
structure moving with the periodic motion. 
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Description 

[0001] The present invention relates to image 
processing and more specifically to imaging structures 
having motion defined by a cycle. 
[0002] Moving structures are difficult to image, espe- 
cially if an imaging plane is set in space with the struc- 
ture moving in and out of the imaging plane. This is es- 
pecially difficult when a second periodic motion is add- 
ed. For example, imaging of structures in a subject 
which is breathing causes a periodic motion of internal 
structures. This is further complicated by the beating 
motion of the heart if the structure is on, or near the 
heart. The beating of the heart is a complex compres- 
sional and twisting motion superimposed on the respi- 
ratory motion. 

[0003] It is often desirable to acquire images of mov- 
ing structures, such as in coronary angiography, where 
images are acquired of vessels in a beating heart. For 
image enhancement purposes, several images are av- 
eraged to reduce image noise, and improve visualiza- 
tion. 

[0004] MR coronary angiography has typically been 
performed using either breath-held, oblique single-slice 
techniques, or respiratory-gated 3D techniques. Re- 
peated breath holding may not be feasible for some cor- 
onary patients, and navigation techniques to date have 
not generally provided a robust method which works 
over a range of different breathing patterns in a variety 
of patients. Moreover, in both of these approaches, suc- 
cess or failure is often not apparent for some time after 
the start of imaging. The purpose of this study was to 
develop a robust, non-breath-held technique for coro- 
nary MRI based on adaptive averaging. 
[0005] Currently, there is a need for an imaging meth- 
od which creates clearer images of moving structures 
than previously possible. 

[0006] In the imaging method of the invention, high 
quality real-time images of a desired structure having 
periodic motion are acquired from a subject. 
[0007] Several images are captured and displayed to 
a user. The user interactively selects an image contain- 
ing the desired structure as a reference image R. 
[0008] A region of interest (ROM) is identified on ref- 
erence image R encompassing the desired structure. 
[0009] ROM is then cross-correlated with each suc- 
cessive captured image to result in a cross-correlation 
image. In the most efficient embodiment, cross-correla- 
tion is performed by multiplication in the Fourier, or k- 
space, domain. 

[0010] A second region of interest is defined in the 
center of the cross-correlation image. When the cross- 
correlation image shows a peak within the region of in- 
terest, and more than a predetermined distance away 
from an edge of the region of interest, a "usable" image 
is identified. 

[0011] A number of usable images are acquired and 
may be shifted and averaged, or sorted by their offsets 



and only those with similar offsets are averaged. 
[0012] This produces averaged images with less blur- 
ring, since there is compensation for offsets. Also, av- 
eraging provides a higher quality image. 
5 [001 3] In an alternative embodiment, feedback is pro- 
vided to the data source when the current image is a 
"useable" image. Additional information is acquired to 
augment the original raw data, and a higher-resolution 
image results. 

w [001 4] An object of the present invention is to provide 
a system which provides high signal-to-noise images of 
structures having periodic motion. 
[0015] Another object of the present invention is to 
provide high signal-to-noise images of structures of sub- 

15 jects without requiring the subjects to hold their breath 
during imaging. 

[0016] Another object of the present invention is to 
provide high signal-to-noise images of coronary struc- 
tures of subjects while the subjects are breathing nor- 
20 mally. 

[0017] The features of the invention believed to be 
novel are set forth with particularity in the appended 
claims. The invention itself, however, both as to organ- 
ization and method of operation, together with further 

25 objects and advantages thereof, may be best under- 
stood by reference to the following description taken in 
conjunction with the accompanying drawing in which: 
[0018] Figures 1-4 are real-time, ungated, non- 
breath-hold images of a cross section of a subject's 

30 heart. 

[0019] Figures 5-8 are cross correlations of a region 
of interest 1 (RO1 1 ) with each of Figures 1 -4, respective- 
ly- 

[0020] Figure 9 is a cross sectional image of the sub- 
55 ject acquired from averaging images of Figs. 1 -3. 

[0021] Figures 10 and 11 together are a simplified 
block diagram of an embodiment according to the 
present invention. 

[0022] Several problems are encountered during im- 

40 aging of moving structures. These apply for many dif- 
ferent disciplines, but one of the best uses would be in 
coronary angiography. It will be explained for this use, 
but may be used for any imaging of structures undergo- 
ing periodic motion where the structure will pass in and 

45 out of an imaging plane. 

[0023] Vessels of the heart may move in and out of 
an imaging plane due to beating of the subject's heart. 
The subject's breathing may also cause coronary ves- 
sels to move in and out of the imaging plane as the sub- 

50 ject's chest moves. 

[0024] If one were to identify images in which a de- 
sired coronary vessel was in an imaging plane, and use 
these images to create an average image, or a series 
of images, image quality would be greatly enhanced. 

55 Further, if one were to recover the offset of the coronary 
vessel in each image, one could use that offset to correct 
the position of the image before averaging with others 
in the sequence, thus avoiding blurring due to motion of 
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the vessel in the imaging plane. 

[0025] The user interacts with the system, while view- 
ing a real-time imaging window, to define a region of in- 
terest (ROM) around a desired vessel. This ROM is 
used to create a kernel which is cross-correlated with 
each new frame as it is acquired. To accelerate the 
cross-correlation, it is performed by multiplication in the 
Fourier (k-space) domain. 

[0026] Frames which closely match the reference ker- 
nel produce a cross-correlation with a relatively large 
central peak. Those frames in which the anatomy is 
translated within the plane will produce an offset in the 
peak, and those frames where the vessel has moved 
out of plane will have a relatively small signal in the cen- 
tral region. A peak threshold is used as a basis for re- 
jecting frames. Images may be translated before aver- 
aging, if there is no rotation or deformation, and the off- 
set of the peak from the center of the cross-correlation 
image indicates the translation required to align the orig- 
inal image. Images which have peaks which are greater 
than a predetermined spatial offset from the center, are 
also rejected. 

[0027] In Figures 1 through 4, cardiac angiographic 
images which are not gated with either the breathing or 
cardiac cycles were acquired while the subject was 
breathing normally Each image represents a specific 
time period during the cardiac cycle. 
[0028] ROM was drawn around the vessel, in one of 
the images where the vessel was clearly visible. In Fig- 
ure 1 ROM is a white box which encompasses most of 
a coronary artery which is the light colored line. This 
same artery can be seen in Figures 2 and 3, however, 
in Figure 4 the heart has moved into a position where 
that artery is no longer within the imaging plane. 
[0029] The cross-correlations for Figures 1 , 2, 3, 4 are 
shown in Figures 5, 6, 7, 8, respectively Figure 5, 6, 7 
show prominent correlation peaks arising from the close 
correspondence between the base images (Figs. 1, 2, 
3) and the kernel (Fig. 5 is in fact an autocorrelation). 
The coronary in Fig. 3 is translated within the plane be- 
cause of respiratory motion, and the correlation peak in 
Fig 7 is likewise shifted up. A threshold was set as an 
acceptance criterion, and accepted frames from the full 
data set were averaged. The average of Fig. 1 and shift- 
ed Figs. 2 and 3 resulted in Fig. 9, which is clearer than 
each image taken on its own. 

[0030] Figures 10 and 11 together show a simplified 
block diagram of the coronary angiography system of 
the present invention. A user 1 interacts with a user in- 
terface 13 which provides input to an image acquisition 
device 3 which may possibly be a magnetic resonance 
(MR) scanner, or other imaging device which acquires 
raw data in k-space. Image acquisition device 3 ac- 
quires image data, such as coronary angiography slic- 
es, and stores them in a raw buffer 5 which is unproc- 
essed MR data and is still in the Fourier time domain, 
or "k-space". This raw data represents a plurality of MR 
images. The images acquisition device and the raw buff- 



er act together as a data source 6. 
[0031] The raw images are provided to a two-dimen- 
sional fast Fourier transform (2DFT) device 7 which 
transforms these back into the image space domain and 

5 fills a circular buffer 9 with images. 

[0032] User 1 interacts with user interface 1 3 to select 
one of the images in circular buffer 9 interactively dis- 
played on a display device 11 , as a reference image R. 
[0033] User 1 then interacts with user interface 13 to 

10 select a region of interest (RO1 1 ) on reference image R 
which encompasses a desired structure to be imaged, 
such as a coronary vessel. 

[0034] ROM from interface 13 is provided to a mask 
device 1 5 which creates a mask M of zeroes on all areas 

15 outside of the RO1 1 and ones inside RO1 1 . 

[0035] Mask M is provided to a multiplication device 
17 along with selected reference image R from circular 
buffer 9 and multiplied to result in a masked image l m 
being essentially zeroes outside the RO1 1 and a portion 

20 of reference image R inside of ROM . 

[0036] Mask M is provided to an inverse Fourier trans- 
form device 21 to provide a k-space representation of 
mask M. 

[0037] This k-space representation of mask M has all 
25 of its coordinates flipped with respect to the x axis in a 
flip X device 25, and this result is passed to a flip Y de- 
vice 29 which flips all of these coefficients with respect 
to the Y axis to result in a set of weighting coefficients 
W stored in weighting memory 33. 
30 [0038] A similar process occurs to masked image l m 
with inverse FFT device 1 9, flip X device 23, flip Y device 
27, respectively. The output of flip Y device 27 is a kernel 
set K which is stored in kernel memory 31 . 
[0039] Both kernel set K and weighting set W are in 
55 k-space. Kernel set K and weighting set W are used to 
multiply k-space image data D from raw buffer 5. A k- 
space image slice D from raw buffer 5 is provided to mul- 
tipliers 35 and 37 with each weighting set W and kernel 
set K, respectively. 
40 [0040] The result of multipliers 35 and 37 are provided 
to forward two dimensional Fourier transform (2DFT) 
devices 39 and 41 , respectively, to produce image 
space representations (A-,, $-,); (A 2 , $ 2 ), respectively 
where A is the amplitude information, and $ is the phase 
45 information. 

[0041] Magnitude devices 43 and 45 receive the 
phases and amplitudes from their respective forward 
2DFT devices and create image magnitudes ||l-,|| and||l 2 || 
representing the magnitude of the image at each point 
50 over the two dimensions of the image. At each location, 
l 2 is divided by I-, to result in l c being the intensity of the 
correlation at that location. This results in a two-dimen- 
sional correlation map. 

[0042] The elements encompassed by the dashed 
55 line perform a correlation in k-space, and are collectively 
referred to as a k-space correlation device 30. 
[0043] A find max device 49 determines if a peak, be- 
ing a local maximum intensity of l c over a second region 
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of interest (ROI2) centered within the two dimensional 
cross correlation image field. ROI2 may be predeter- 
mined and stored, or may be user provided through user 
interface 13. 

[0044] The location of the largest image intensity l c on 
the correlation map within ROI2 is subtracted from the 
center of the image to determine an offset. The height 
of the maximum correlation image intensity l c is the max- 
imum correlation value R. 

[0045] An image selection device 51 receives R in the 
offset from find max device 49, and also receives a k- 
space image from raw buffer 5. 

[0046] Image selector 51 has logic predefined in it to 
determine if there is a peak in the correlation map, and 
also determines if the peak is within a predetermined 
distance from the edges of the correlation image. It may 
also determine if there is no peak but is steadily increas- 
ing correlation intensity values l c toward the edge of the 
ROI. This indicates that the ROM does not overlap the 
coronary vessels of the correlated image. If this is the 
case, the image is discarded and another image is pro- 
vided to multipliers 35 and 37 with the process repeated 
up until this point. 

[0047] However, if image selection device 51 deter- 
mines that there is a peak l c and it is more than a mini- 
mum distance from the edge of ROI, it determines that 
this is a good image, a "usable" image, and a forward 
2DFT device 52 transforms the it into image space and 
provides the image to a router device 53 along with the 
offset information. 

[0048] I n one embodiment router 53 merely stores im- 
ages in a segmented memory 55 which has a plurality 
of locations each capable of holding the information rep- 
resenting an image slice. 

[0049] In a second embodiment, router 53 receives 
more images and offsets than the number of bins in 
memory 55. A sorter 52 within router 53 then stores im- 
ages with a predetermined offset range in each of the 
bins in segmented memory 55. Each additional image 
placed in a bin is averaged with an ongoing average of 
all the previous images stored in that bin. 
[0050] This results in an "averaged movie", in which 
heart motion is essentially removed, and the coronary 
is seen moving up and down with respiration. 
[0051] In still another embodiment, router 53 may be 
embodied by a shift device 57connected to image se- 
lection device 51 . It receives the images and their offsets 
and shifts each image by its offset to normalize the im- 
ages, then provides the shifted image to an averager 
59. Averager 59 also receives the contents already in a 
running memory 61 , being a running image average. Av- 
erager then averages these images and stores them as 
a new running average in running memory 61. Each of 
these embodiments will have different uses and results. 
[0052] This adaptively averaged image shows 
marked improvement in signal-to-noise ratio (SNR) rel- 
ative to the real-time images. Adaptive averaging is fea- 
sible for coronary imaging. 



[0053] In still another alternative embodiment, image 
acquisition device 3 may be coupled to, and responsive 
to, image selection device 51 . Images may be acquired 
in a normal, or abbreviated manner to increase the 

5 speed of acquisition during normal imaging. However, 
when image selection device 51 determines that there 
is the desired structure in the current image D, indicated 
by a high correlation peak in correlation image, a signal 
is sent to image acquisition device 3 to acquire addition 

10 image information. This may mean that image acquisi- 
tion device 3 samples lower spatial frequencies in k- 
space during quick acquisitions, but samples higher 
spatial frequencies upon receiving the signal from im- 
age selection device 51 . The additional information may 

15 be passed directly to, image selection device 51 , or pass 
through raw buffer first, and is intended to augment the 
already acquired raw image data D. This allows higher 
resolution images to be acquired when the desired 
structure is visible, while acquiring lower resolution, 

20 "quick" images at other times. 

[0054] Since there is a first display 11 and a second 
display 71 , at least two different representations may be 
simultaneously displayed to user 1 . First display 1 1 may 
run real-time image of the subject's beating heart, or 

25 may disconnect and play any, or all, of the images saved 
in circular buffer 9. 

[0055] Second display may play the "averaged mov- 
ie" while comparing this to the real-time display of 1 st 
display means 11, or have an averaged image of run- 
30 ning memory 61 which is updated according to users 
input. It is possibly to have the updating proceed con- 
tinuously. 

[0056] Second display 71 may also play all, or any, of 
the images in memory 55 which may be continuously 
55 updated or static. 

RESULTS 

[0057] The coronary image of Figures 1-4 were ac- 

40 quired using a spiral fluoroscopy pulse sequence on a 
high-performance gradient system (Signa Horizon 
EchoSpeed, GE Medical Systems). The scanner was 
controlled from an UltraSparc 2 and images transferred 
back, reconstructed, and displayed to produce a real- 

45 time view of the beating heart. The 6-interleave spiral 
pulse sequence produced a matrix size of 1 28x1 28, with 
5 complete new images per second and 9 reconstruc- 
tions per second. Screen-based tools were used to in- 
teractively Ibcate optimal coronary scan planes within 

50 1 0-20 seconds, prior to adaptive coronary imaging. 
[0058] Real-time spiral fluoroscopy with adaptive av- 
eraging shows potential as a robust technique for coro- 
nary MRI. It requires no breath-holding, no separate 
navigation sequence, and no ECG gating. Moreover, it 

55 allows continuous visualization of the vessel of interest 
from the start of imaging. Interactive location of coronary 
scan planes can be readily interleaved with adaptive av- 
eraging during real-time imaging of those scan planes. 
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Claims 

1 . A method for acquiring high-quality images of a de- 
sired structure having periodic motion in a series of 
images comprising the steps of: 

a) displaying the series of images to accept us- 
er-supplied input identifying a selected image 
containing the desired structure as a reference 
image R; 

b) identifying a region of interest ROM in refer- 
ence image R encompassing the desired struc- 
ture; 

c) cross-correlating RO1 1 with each of the other 
images from the series of images to result in a 
series of cross-correlation images; 

d) defining a second region of interest ROI2 
centered in each cross-correlation image; 

e) identifying images as "usable" images, which 
have a peak within ROI2 of their cross-correla- 
tion image more than a predetermined distance 
away from an edge of ROI2; 

f) processing only the "usable" images, to result 
in a higher quality processed image. 

2. The method for acquiring high quality images of 
claim 1 wherein the step of performing a cross-cor- 
relation comprises the steps of: 

a) inverse Fourier transforming the reference 
image R within the RO1 1 into a k-space image; 

b) flipping the k-space image with respect to its 
X coordinates; 

c) flipping the k-space image with respect to its 
Y coordinates to result in a kernel set K; 

d) creating a mask M having zeros outside of 
the ROM and ones inside of ROM ; 

e) inverse Fourier transforming mask M into a 
k-space image; flipping the k-space image of 
mask M with respect to its X coordinates; 

f) flipping the k-space image of mask M with re- 
spect to its Y coordinates to result in a weight- 
ing set W; 

g) multiplying the kernel set K and weighting 
set W each by a raw data image D to result in 
product K, and product W respectively; 

h) performing a 2D forward Fourier transform 
on product K and product W to result in ampli- 
tude and phase information (A 2 , $ 2 ), and (A-,, 
$-,); respectively; 

i) determining the magnitudes, ||l 2 ||, Hl-JI from in- 
formation (A 2 , $2), and (A-,, $-,); respectively; 
and 

j) determining a cross-correlation image l c ac- 
cording to: 




5 3. The method for acquiring high quality images of 
claim 1 wherein the cross-correlation is performed 
by multiplication in k-space to result in rapid cross- 
correlation. 

10 4. The method for acquiring high quality images of a 
desired structure of claim 1 further comprising the 
steps of: 

a) calculating offsets from the location of cross- 
es correlation peaks of usable images from a cent- 
er point of their cross-correlation images; 

b) translating the usable images by the offset 
amount to correct for the offset; and 

c) averaging the translated images to result in 
20 processed images with reduced blurring. 

5. The method for acquiring high quality images of a 
desired structure of claim 1 further comprising the 
steps of: 

25 

a) calculating offsets from the location of cross- 
correlation peaks of usable images from a cent- 
er point of their cross-correlation images; 

b) sorting images according to their offsets; 
30 c) playing back the images in their sorted order 

to provide an "averaged movie" which changes 
according to the offset. 

6. The method for acquiring high quality images of a 
35 desired structure of claim 3 wherein: 

a) the images are coronary angiography imag- 
es of a subject breathing during acquisition; 

b) the structure imaged is coronary vessel; 
40 c) offsets are due to breathing motion; and 

d) the "averaged movie" essentially removes 
heart motion. 

7. A system for displaying high quality processed im- 
45 ages derived from a series of images acquired from 

a desired structure having periodic motion compris- 
ing: 

a) a data source for acquiring a plurality of raw 
50 images in Fourier k-space, and for providing 

these images to connected elements; 

b) an interactive image selection device cou- 
pled to data source 6 for selecting and display- 
ing user defined images, and operating to de- 

55 fine an ROM on a user-selected reference im- 

age R; 

c) a mask device coupled to the interactive im- 
age selection device for operating to receive 
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ROM and create a mask M having all zeroes 
outside of ROM and all ones inside of ROM; 

d) a k-space correlation device coupled to in- 
teractive image selection device, mask device, 
and data sources, for creating a cross-correla- 5 
tion image l c from reference image R, mask M 
and raw data image D; 

e) a find max device coupled to the k-space 
cross-correlation device operating to calculate 

if a peak exists, and a peak height, and an offset to 
of the peak from the center of the cross-corre- 
lation image l c for existing peaks; 

f) an image selection device coupled to find 
max device and from raw buffer, operating to 
receive the offset, and peak height, raw data is 
image D, and determine if the peak height is 
greater than a predetermined threshold, and 

the offset is less than a predetermined thresh- 
old defining a "usable" image, and operating to 
performing a 2D Fourier transform on "usable" 20 
images; 

g) an image memory capable of storing and re- 
trieving a plurality of images; 

h) a router coupled to image selection device, 
operating to receive the 2DFT representations 25 
of usable images and further process these im- 
ages, then store these processed images in im- 
age memory; and 

i) a display device coupled to the image mem- 
ory for displaying the processed images stored 30 
in image memory. 

8. The system for displaying high quality processed 
images of claim 7 wherein the router comprises a 
sorter which processes images by sorting usable 35 
images provided to it according to their offset. 

9. The system for displaying high quality processed 
images of claim 7 wherein the router comprises: 

40 

a) a shift device for receiving image and offset 
translating each image at its offset; 

b) a running memory capable of storing image 
data, containing a running image average; and 

c) an averager coupled to the running memory 45 
and shift device, for receiving and averaging 

the running average image and the translated 
image from the shift device and storing the re- 
sult in the running memory. 

50 

10. The system for displaying high quality processed 
images of claim 7, wherein: 

a) image acquisition device has operates in at 
least two modes, the first being "quick" acqui- 55 
sition of abbreviated images; and upon receiv- 
ing a signal operates in a second mode being 
a high-resolution acquisition mode; 



b) the image selection device is connected to 
the image acquisition device, and sends a sig- 
nal to image acquisition device when a current 
"usable" image is detected, causing it to ac- 
quire additional information which supplements 
the original raw data D. 
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